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Abstract 

We consider a pair (X, Y) of processes satisfying the equation dX = a{X)YdB 
driven by a Brownian motion and study the monotonicity and continuity in y of the value 
function v(x,y) = sup T E x _ y [e~ qT g(X T )], where the suprcmum is taken over stopping 
times with respect to the filtration generated by (X, Y) . Our results can successfully be 
applied to pricing American options where X is the discounted price of an asset while 
Y is given by a stochastic volatility model such as those proposed by Hcston or Hull & 
White. The main method of proof is based on time-change and coupling. 
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1 Introduction 

Consider a two-dimensional strong Markov process (X, Y) = (Xf,Yt, t > 0) with state space 
R x S, S C (0, oo), given on a family of probability spaces (f2, J-, P x ,y, (x, y) 6Kx5) which 
satisfies the stochastic differential equation 

dX = a{X)YdB (1) 

where B = (Bt)t>o is a standard Brownian motion and a : R — > R is a measurable function. 

Processes of this type are common in mathematical finance and, in this context, X 
would be the discounted price of an asset while Y is a process giving the so-called stochastic 
volatility. 

We shall refer to this application in the examples, as it was our motivation in the 
beginning. However, the methods used are of a broader nature and can be applied in a 
wider context. 

This paper mainly deals with the regularity of the value function 

v(x,y)= sup E x , y [e- qr g{X T )}, {x,y)€RxS, (2) 

0<t<T 

with respect to the optimal stopping problem given by (X, Y), a discount rate q > 0, a 
time horizon T G [0, oo] and a measurable gain function g : R — > R. But for financial 
applications, see Section [5j a slightly modified value function of type 

v(x,y)= sup E x , y [e- rT g(e rr X T )} (2') 

0<t<T 
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is also considered where r stands for the instantaneous interest rate. 

The supremum in ([2]) and (2') is taken over all finite stopping times with respect to the 
filtration generated by the pair of processes (X, Y). 

To ensure the well-posedness of this problem, we assume the integrability condition 
(recall that T may be infinite) 



which is a common assumption in the context of optimal stopping problems. 

Note that this condition is satisfied if g is bounded. For more general functions, verifying 
this condition can be fairly difficult and its validity may depend on the particular choice of 
the dynamics for (X,Y). 

Our main focus is on proving the monotonicity of v(x,y) with respect to y € S and we 
are able to verify this property in the case of the following two classes of strong Markov 
processes under not too restrictive conditions (see Theorem 12.51 and Theorem I3.-5|) : 

• Regime- switching: Y is an irreducible continuous-time Markov chain which is inde- 
pendent of the Brownian motion B driving the equation ([T]). 

• Diffusion: Y solves a stochastic differential equation of the type 



where B = [B{)t>o is a standard Brownian motion such that (B, B )t = 5t, t > 0, 
for some real parameter 5 S [— 1, 1] and rj, : M — > ~R are measurable functions. 

Remark that, in the second class, the joint distribution of X and Y is uniquely determined 
if the system of equations (jXJ) , ((4]) admits a weakly unique solution and the process Y does 
not have to be independent of the driving Brownian motion B, whereas, in the case of the 
first class, the process Y is not given by an equation and the assumed independence of 
Y and B is a natural way of linking X and Y if there is too little information about the 
structure of the pair (X,Y). 

Our technique is based on time-change and coupling. The equation (TjQ) goes back to 
a volatility model used by Hobson in [H2010] who also applies time-change and coupling 
but for comparing prices of European options. As far as we know, our paper is the first 
paper dealing with the extra difficulty of applying this technique in the context of optimal 
stopping. It should be mentioned that Ekstrom [E2004L Theorem 4.2] can compare prices 
of American options if Y = 1 in equation (TjQ) and a also depends on time. Nevertheless, it 
seems to be that his method cannot be applied in the case of non-trivial processes Y. 

We provide some examples to illustrate the results. In the case of regime-switching, we 
look at the pricing of perpetual American put options which, for a(x) = x, was studied by 
Guo and Zhang [GZ2004J for a two-state Markov chain and by Jobert and Rogers [JR2006) 
for a finite-state Markov chain. While the former, since the situation is much easier, gave a 
closed-form expression for the price the latter could only provide a numerical algorithm to 
approximate the value function which gives the price of the contract. It turns out that the 
algorithm in the case of a chain with many states can be very time-intensive if the unknown 



E 



sup e 

0<t<T 



qt \g{X t )\I(t < oo) <oo for all {x,y)eRxS 



(3) 



dY = n(Y)dB Y + 6(Y)dt 



(4) 
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thresholds which characterize the optimal stopping rule are not known to be in a specific 
order when labelled by the different volatility states before the algorithm starts. However, 
based on our result that the value function v(x, y) is monotone in y, we are now able to give 
conditions under which these thresholds must be in a monotone order. Ultimately, in the 
case where Y is a diffusion, we verify the continuity and monotonicity of the value function 
v(x,y) with respect to y G S = (0,oo) for two important volatility models, the Heston 
[H1993] and the Hull & White [HW1987] model. 

The structure of this paper is as follows. In Section [2] the monotonicity of the value 
function v (x, y) with respect to y G S = {yi : i = 1, 2, . . .} C (0, oo) is shown in the case 
of regime-switching and the main method is established. In Section [3] the main method 
is adapted to the case of a system of stochastic differential equations ([I]),® which is the 
diffusion case while in Section H] we use monotonicity to show the continuity of the value 
function v(x, y) with respect to y G S = (0, oo) in the diffusion case. In Section [5] we 
reformulate our results in the context of option pricing. Then all our examples are discussed 
in detail in Section [6] and, in the Appendix, we prove auxiliary results and some of the 
corollaries. 

Finally, it should be mentioned that all our results and proofs would not change in 
principle if the state space of (X, Y) is R x 5 with S C (— oo,0) instead of S C (0, oo). 
The only change in this case ( see Corollary 12. 7f ii)) would be to order: increasing becomes 
decreasing. However, as pointed out in the proof of Corollary 12. 7( ii). our method cannot be 
applied to show the monotonicity of v(x, y) in y G S if S contains a neighbourhood of zero. 
We do not know either how to generalise our method to the non-martingale case. 

2 The Regime- Switching- Case 

Suppose that (X,Y) = (X t ,Y t , t > 0) is a strong Markov process given on a family of 
probability spaces (0, J 7 , P x ,y, (x,y) 6Kx5) which satisfies the conditions 

CI: the process (X, Y) is adapted with respect to a filtration Tt % t > 0, of sub-cr-algebras 
of T and, for every (x, y) G M x S, there is an Tt Brownian motion B on (O, J 7 , P x ,y) 
independent of Y such that 



C2: the process Y is a continuous-time Markov chain with Q-matrix (q[yi,yj]) on S = 
{yi : i = 1, 2, . . .} C (0, oo) such that 



Remark 2.1 (i) From the above assumptions it immediately follows that, for every ini- 
tial condition there exists a weak solution to the stochastic differential equation 
dG = a(G)dW driven by a Brownian motion W. To see this fix (x,y) 6Mx5 and 
write 




Px, y ( / Y s 2 ds < oo,Vt > 0) = 1, P x ,y(tim / Y^ds = oo) = 1, (x,y) £Kx5. 
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where M s = J^Y u dB u is well-defined since J^Y^du < oo, P^^-a.s., for all s > 0. 
But time-changing X by the inverse of (M), which exists by Condition C2 above, 
yields 




t > 0, P X)?/ — a.s., 



where G = Xo(M)" 1 is T^ M yi - adapted and W = Mo (M) _1 is an T^ h[ yi Brownian 
motion by the Dambis-Dubins-Schwarz Theorem (see |RY1999| V.1.6]). The equation 
does indeed hold for all t > since P XiV (lim^oo Jo Y^ds = oo) = 1. 

(ii) Furthermore, as (M) is a strictly increasing, continuous, perfect additive functional of 
(X,Y) satisfying (M)oo = oo a.s., the time-changed process (X o (M)" 1 ,Y o (M) -1 ) 
is strong Markov with respect to J-.'J i, t > 0, by standard theory on right processes 

(see [S1988t Th.(65.9)] for example). Here T t ' stands for the universal augmentation 
of the filtration a({X s ,Y s : s < t}), t > (see Section 2.7.B of IKS1991I for a good 
account of universal nitrations). Note that the filtration J- t ' can be smaller than 
J~t, t > 0, mentioned in Condition CI on page[3l 

(iii) Because (M) _1 = f Y^^_ 1 ds, an easy calculation shows that the process Y o (M) _1 
is a continuous-time Markov chain with Q-matrix (y^ 2 q[yi,yj]), Vi,Vj € S. 

By the above remark, there exists a strong Markov process which is also a weak solution 
of dG = a{G)dW . The law of this strong Markov process is entirely determined by its 
semigroup of transition kernels. Multiplying these transition kernels and the transition 
kernels of a continuous-time Markov chain on S x S both marginals of which are determined 
by the Q-matrix (y~ 2 q[yi, Vj]), Vi,Vj £ S, results in a semigroup of transition kernels of 
a strong Markov process (G,Z,Z') with G being independent of (Z,Z'). Now choose a 
complete probability space (Cl, J 7 , P) such that (G, Z, Z') starts from fixed (x, y, y') € R X 
S x S. If J- t ' ' denotes the augmentation of the filtration a({G s , Z s , Z' s : s < t}), t>0, 
then, by the martingale problem associated with the strong Markov process G, Gt — x is a 
continuous local T t ' ' -martingale with quadratic variation f£ a(G s ) 2 ds, t>0. Thus, by 
a well-known result going back to Doob (see |IW198l| Th. II 7.1'] for example), there is a 
Brownian motion W such that 

G t -x= [ a(G s )dW s , t>0,P-a.s. (5) 

The construction of W on (O, T, P) (or on a canonical enlargement of it0) as given in the 
proof of Th. II 7.1' in [IW1981j shows that the pair (G, W) is also independent of (Z, Z'). 
But remark that W might only be a Brownian motion with respect to a filtration Tt larger 
than T t ' ' , t > 0, so that the stochastic integral in (J5J) can only be understood with 
respect to the larger filtration. 

The last paragraph can be summarised as follows. 

x Our convention is to use (tl, F, P) for the enlarged space, too. 
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Corollary 2.2 For given (x,y,y') € 1x5x5, there is a complete probability space 
(£l,J-,P) equipped with two filtrations T t ' ' C P t , t > 0, which is big enough to carry 
four basic processes G, W, Z, Z' such that: (G, W) is a weak T% - adapted solution of dG = 
a{G)dW starting from x independent of (Z,Z') ; Z and Z' are Markov chains with Q- 
matrix q[yi,Vj]), Vi,Vj £ S, starting from y and y' , respectively, and (G,Z,Z f ) is a 
strong Markov process with respect to J-f' Z ' Z , t > 0. 

The goal of this section is to show that, under some not too restrictive conditions, for 
fixed iGR and y, y' £ S: 

if y < V then v(x, y) < v(x, y') (6) 

where the value function v is given by ([2]). Choosing x and y < y' , we will construct two 
processes (X,Y) and {X' ,Y') on (fl,J-, P) such that (X, Y) has the same law as (X,Y) 
under P x>y and (X 1 , Y') has the same law as (X, Y) under P x ,y' hence 

v(x,y) = sup E[e-^g(X f )] and v{x,y') = sup E [e^' g(X'-,)] (7) 

0<f<T 0<f'<T 

where f and f' are finite stopping times with respect to the filtrations generated by (X, Y) 
and (X',Y'), respectively. Working on only ONE probability space is an important part 
of our method for proving © which is based on time-change and coupling and which is 
demonstrated below. 

Let G, W, Z, Z' be given on (Ct, P) as described in Corollary 12.21 and define 

It = / Z~ 2 ds, t > 0. 
J o 

This process T = (T t )t>o is of course continuous but also strictly increasing since Z only 
takes non-zero values. Moreover, Condition C2 on page [3] implies that 

Tt < oo, t > 0, a.s., and limTj = oo a.s., (8) 

t\oo 

since, by Remark 12. If hi). Z has the same law as Y o (M)" 1 under P x ,y with J (j Y~^_ 1 ds 

being the inverse of J^Y^ds. Thus A = T _1 is also a continuous and strictly increasing 
process satisfying 

A t < oo, t>0, a.s., and lim^j = oo a.s. (9) 

fcfao 

As a consequence, the two technical properties 
PI: F At = A Tt =t for all i > a.s. 
P2: s < Tt if and only if A s < t for all < s, t < oo a.s. 
must hold. 

Of course, T is adapted to both filtrations T t ' ' and J~t,t > 0. However, A = T 

G Z Z 1 

is considered an T t ' ' - time - change in the following lemma. We denote by M and T 

G Z Z 1 G Z Z 1 

the families of stopping times with respect to the filtrations {T t ' ' )t>o and {J^ ' )t>o, 
respectively. 
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Lemma 2.3 // p G M then T p G T and if r G T then A T G M. 

A similar lemma can be found in [S1988J. Since the above lemma is going to be used 
to reformulate the original optimal stopping problem ([2]) in both the case where Y is a 
Markov chain and the case where Y is a diffusion, its proof is given in the Appendix for 
completeness. 

The reformulation of ([5]) is based on the existence of a suitable solution to (pQ) which is 
constructed next. 

Since Z is J-f-adapted, one can rewrite (|5]) to get 

ft r s dw 

G t = x + / a(G s )Z s dM s , t > 0, a.s., where M s = I s>0. 
Jo Jo Z u 

Observe that the stochastic integral defining M exists by (JSj) - Time-changing the above 
equation by A yields 

X t = x+f a(X s )Y s dB s , t>0, a.s., for X = G o A, Y = Z o A, B = M o A. 
Jo 

Of course, (X, Y) is J-A t ~ adapted and B is an J-A t Brownian motion by the Dambis-Dubins- 
Schwarz Theorem |RY1999| V.1.6]. Thus (X,Y) gives a weak solution to (pQ) starting from 
(x,y). Moreover, B and Y are independent since W and Z are independent. The proof of 
this is contained in the Appendix (see Lemma A.l). 

Proposition 2.4 Let G,X,Y be the processes on (Cl, J 7 , P) introduced above and starting 
from Gq = Xq = x and Yq = y. If the stochastic differential equation 

dX = a{X)YdB, (X, Y) unknown, 

driven by a Brownian motion B, where Y is required to be a continuous-time Markov chain 
independent of B with Q-matrix (q[yi,yj]), y%,yj G S, admits a weakly unique solution then, 
for any T G [0, oo]: 

v{x,y) = sup E [e~ qT g{X T )\ = sup E [e^" g(G p )} 
re7r peMr 

where 

Tt = {t£T:0<t<T} and M T = {p G M : < p < A T }. 
Here, T and Ai denote the families of finite stopping times with respect to the filtrations 
(FaI Z,Z )t>0 and (T^' Z ' Z ) t >o, respectively. 

Proof. First note that T is a continuous, strictly increasing, perfect additive functional 
of (G,Z,Z ! ) which satisfies ([8]) and recall that {G,Z,Z') is a strong Markov process with 
respect to lf' Z,Z \ t > 0, by Corollary O So {G o A, Z o A, Z' o A)— and hence its 
marginal [X, Y) — must possess the strong Markov property with respect to J- A ' t ' , t > 0, 
by [S19881 Theorem 65.9]. But A = T _1 = J Q Y^ds by time-changing the integral defining 
r. So Y is a continuous-time Markov chain with Q-matrix (q[yi,yj]), yuVj G S. Combining 
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these statements, (X,Y) has the same law as (X,Y) under P x ,y, since both pairs satisfy 
the equation dX = a(X)YdB in the sense explained in the proposition and this equation 
admits a weakly unique solution. As a consequence it follows from (J7|) that 

v(x,y)= sup E[e-" T g(X T )} 
0<t<T 

where the finite stopping times r are with respect to the filtration J^' Z ' Z , t > 0. Here 
one should mention that the stopping times used in ([7]) are with respect to the filtration 
generated by (X, Y) which might be smaller than Tj^ ' , t > 0. However, it is well-known 
(see [S19781 Cor. 2, Sect. 3.3] for example) that the corresponding suprema are the same if 
the underlying process, in this case (X, Y), is also strong Markov with respect to the bigger 
filtration. 

It remains to show that 

svpE[e-* r g(X T )]= sup E[ e -^g(G p )}. (10) 

t67t peMr 
Fix t G Tt and observe that 

E[e'^g(X T )} = E[e-^g(G AT )] 

by Property PI and the construction of X. Then A T is an J ( ' ' - stopping- time by 
Lemma 12.31 The right-hand side above does not change if a finite version of A T is chosen 
which still is an JF t ' ' - stopping- time, since the filtration satisfies the usual conditions. 
Thus A T G A4t and it follows that 

E[e-« T g(X T )} < sup E [e~"^g(G p )]. 

P&Mt 

Similarly, for fixed p G Mt, the equality E [e~ qr pg(G p )) = E [e~ qr Pg(Xr p )] leads to 

^[e-" r ^(G p )]< sup E[e-" T g(X T )] 

t£T T 

finally proving ([10)) , □ 

Of course, the conclusion of Proposition 12.41 remains valid for v(x,y'), X' , Y', 7^, M.' T , 
A' and T' if these objects are constructed by using Z' instead of Z. Notice that the solution 
G is the same. 

We are now in the position to formulate and prove the main result of this section about 
the validity of ([!]). 

Theorem 2.5 Let (X, Y) be a strong Markov process given on a family of probability spaces 
(f2, J 7 , P x , y , (x, y) £ R x S) and let g : E — > K be a measurable gain function such that 
> 0} ^ 0. Assume (0), that (X, Y) satisfies Conditions CI and C2 on page\M and that 
all pairs of processes satisfying Conditions CI and C2 have the same law. Further suppose 
that Y is skip-free. Define fC^~ to be the collection of all finite stopping times r < T with 
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respect to the filtration generated by (X,Y) such that g(X T ) > 0. Fix (x,y) £Kx5 and 
assume that v(x,y) = sup rg/c9 + E x>y [e~ QT g(X T )]. Then: 

v(x, y) < v(x, y) for all y' £ S such that y < y' , 
so that v(x, y) is a lower bound for v(x, ■) on [y, oo) n S. 

Remark 2.6 (i) The condition v(x, y) = sup rg ^- 9 + E XiV [e~ qr g(X T )] is a technical con- 
dition which states that the optimum v(x,y) as defined by ([2]) can be achieved by 
stopping at non-negative values of g only. It is of course trivially satisfied for all 
(x,y) £ R x S if the gain function is non- negative and in this case the theorem means 
that v(x, •) is increasing. 

(ii) In the case of an infinite time horizon T = oo, it easily follows from the section 
theorem |RY19991 IV.5.5] that 

P xy ( inf{i > : g(X t ) > 0} < oo ) = 1 for all (x, y) £ M x S 



x,y 

is sufficient for v(x,y) = sup T£K - 3 + E XjV [e~ qT g(X T )] to be true for all (x,y) 6lx5 

since (X, Y) is strong Markov. Indeed, if a process always hits the set {g > 0} with 
probability one then it is quite natural that maximal gain is obtained whilst avoiding 
stopping at negative values of g. One can easily construct processes satisfying this 
sufficient condition where the gain function g takes both positive and negative values. 

(iii) In the case where T < oo, the only reasonable sufficient condition the authors can find 
is the trivial condition g{x) > for all x € R. This is because, in general a process is 
not almost surely guaranteed to hit a subset of the state space in finite time. 

(iv) The skip-free condition on Y is , of course, equivalent to saying that the Q-matrix is 
tridiagonal. 

Proof of Theorem 12.51 Fix x £ R and y,y' £ S such that y < y' and let G, W, Z, Z' 
be given on a complete probability space (Cl, P, P) as described in Corollary 12.21 While 
in Corollary 12.21 the coupling of the two chains Z and Z' was not specified any further we 
now choose a particular coupling associated with a Q-matrix £} which allows us to compare 
Z and Z' directly. Denoting the Q-matrix corresponding to the independence coupling by 
I}- 1 , we set 



for yi,yj,yk,yi £ S, that is, Z and Z' move independently until they hit each other for the 
first time and then they move together. It follows from the skip-free- assumption that Z 
cannot overtake Z' before they hit each other for the first time. Hence 











Vi 




: i^k 


Vi 


Vj ' 






_ Vk 


m _ 


_ Vk 


yi _ 


= < 




2 q[yi,yj] 


: i = k, j = 1 















■ i = k, j ^k 



< y' = Zq implies Z t < Z[, t > 0, a.s., 
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which results in the inequality 

r t = I Z~ 2 ds > [ (Z' s )- 2 ds = T' t , t> 0, a.s. (11) 
Jo Jo 

Note that then the inverse increasing processes A = T™ 1 and A' = (T') -1 must satisfy the 
relation A t < A' t , t > 0, a.s. 

Now recall the definition of Mt m Proposition 12.41 and note that the above comparison 
allows us to conclude that 

E [e' qr "g(G p )} < E [e^ g(G p )} for every p e M+ (12) 

where = {p G M T ■ g(G p ) > a.s.}. Thus 

E[e~ qr "g(G p )] < sup E [e~ qV 'p' g{G p ,)] for every p G 7W+ 
p'€M' T 

since At < A' T a.s. implies that every stopping time in A4j, has a version which is in M' T . 
Putting these results together, we obtain: 

sup E[e-^»g(G p )] < sup E [e"^' g(G p ,)]. 
p&M^ p'eM' T 

But, if 7y" denotes {r £ 7r : g{X T ) > a.s.}, then the equality 

sup E [e' qr g(X T )} = sup E [e~ qT ?g(G p )] 

can be shown in the same way that (|10p was shown in the proof of Proposition 12.41 (note 
that in this proof we may choose versions of certain stopping times and this is the reason 
the qualification 'a.s.' appears in the definitions of Ad^, and 7jT). 
Furthermore, 

if v(x,y) = sup E Xty [e~ qT g(X T )], then v(x,y) < sup E [e~ qr g(X r )} 

since the law of (X, Y) is equal to the law of (X, Y) under P x>y and the filtration T ' A ' ' , t > 
0, is at least as big as the filtration generated by (X, Y). So, under the condition v(x, y) = 
sup Tg £. 9 + E XiV [e~ qT g(X T )], we can finally deduce that 

v(x,y) < sup E[e- qT g(X T )} = sup E [e~ qr ^ g(G p )} < sup E [e^ 1 g{G p ,)\ = v (x, y'), 
reT+ p&M+ p'eM' T 

where the last equality is due to Proposition 12.41 applied to (X',Y r ). □ 

Corollary 2.7 (i) If {g > 0} = but all other assumptions of Theorem \2.5\ are satisfied 
then, in the infinite time horizon case where T = oo: 

v(x,y) > v(x, y ) for all x G R and y,y' G S such that y < y' , 

so that v(x,-) is decreasing. 
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(ii) Let the assumptions of Theorem \2.5\ be based on S C (—00, 0), fix (x,y) 6Rx5 and 
assume that v(x,y) = sup re ^ 9 + E XtV [e~ qT g(X T )\. Then: 

v(x,y) > v(x,y') for all y' G S such that y < y' , 

so that v(x, y) is an upper bound for v(x, •) on [y, 00) n S. 

Proof. If {g > 0} = then, instead of (|12p . we obtain 

E [e~ qV eg(Gp)\ > E [e- qV 'p g{G p )} for every p e M T 

and M.t is (up to versions) equal to M! T since T = 00. Hence (i) can be deduced directly 
from Proposition 12.41 Note that the above inequality cannot be used in the case where 
T < 00 since there can be stopping times in J\i' T which are not in J\At- 

If S C (—00, 0) then Z t < Z' t , t > 0, a.s., does not imply (fTTj) but instead 

r t = / Z s " 2 d S < / (Z' s )- 2 ds = T' t , t> 0, a.s., 
Jo Jo 

hence, interchanging the roles of y and y' , (ii) can be proved like Theorem 12.51 Note that 
Zt < Z[, t > 0, a.s., would not lead to any comparison between T and r' if y < < y'. 
Hence our method cannot be applied to show the monotonicity of v(x, y) in y £ S if S 
contains a neighbourhood of zero. □ 



3 The Diffusion-Case 

Fix 5 € [—1, 1] and suppose that (X,Y) is a strong Markov process given on a family of 
probability spaces (O, J 7 , P X y, (x,y) 6tx5) which satisfies the conditions 

CI': the process (X,Y) is adapted with respect to a filtration J^, t > 0, of sub-cr- algebras 
of J- and, for every (x, y) 6Rx5, there is a pair (B, B Y ) of J-i Brownian motions on 
(CI, J 7 , -Px,?/) with covariation (B,B Y )t = St, t > 0, such that 

Z t = X + f a(X s )Y s dB s & Y t = Y + f \(Y s )dB Y + f 9(Y s )ds 
Jo Jo Jo 

for all £ > 0, — a.s., 
C2': the process Y takes values in S C (0, 00) and 

■P*,!/ ( / ^ 2 ^s < 00, Vt > 0) = 1, P xy ( lim / y s 2 <is = 00) = 1, (x, y) eKx5. 
Jo ' *t°° Jo 

Remark 3.1 Under the assumptions above, for every (x, y) 6lxS, there exists a weak 
solution to the system of stochastic differential equations 

dG = a(G)dW, \ 

dZ = vm- l dWt + 6(Oi- 2 dt, I (13) 
5t 6 S,i>0, J 
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driven by a pair of Brownian motions with covariation (W, W^)t = 5t, t > 0. Such a 
solution can be given by (Xo(M)~ 1 , Y o (M)" 1 ) where M denotes the continuous local 
martingale M s = f°Y u dB u , s > 0, as in Remark O^i). Here W = M o (M)' 1 and 

= Jq M ^' Y s dB^ are J 7 ^)- 1 Brownian motions by the Dambis-Dubins-Schwarz 
Theorem (see [RY19991 V.1.6]) with covariation 

(W,W*) t = (J Y 9 dB 9) J Y 9 dBY) (M)T i 

= 6 j Yfds = 5{M) {M) -i = St, t>0, P x>y -a.s., 

where the last equality is ensured by Condition C2'. 

We want to show (|SJ) using a method similar to the method applied in Section The 
main difference to the case discussed in Section [2] is that the pair (X,Y) is now determined 
by a system of stochastic differential equations. So, instead of constructing X by time- 
changing a solution of the single equation dG = a(G)dW as in Section [21 we now construct 
X by time-changing a solution of a system of stochastic differential equations. Furthermore, 
in Section [2] we constructed the coupling of Z and Z' in the proof of Theorem 12.51 from a 
given generator. In this section we will couple £ and £' — both satisfying the second equation 
in (|13p but starting from y < y', respectively — we will do so directly from the stochastic 
differential equation. The next condition should be understood in this context. 

C3: Let a, rj, 8 be measurable functions such that the system <|13 jt of stochastic differential 
equations has, for all initial conditions (Go, £o) £ Rx5, a unique non-exploding strong 
solution taking values in R x S. 

Now choose a complete probability space (Q, JF, P) big enough to carry a pair of Brownian 
motions (W, W^) with covariation (W, W^)t = 5t, t > 0, and denote by Ft, t>0, the usual 
augmentation of the filtration generated by (W,W^). Let (G, £) be the unique solution of 
the system (fT3l) starting from Go = x G R and £o = 2/ 6 <5 given on (f2, T, P) by (W, W^). 
Define T = (T t ) t >o by 

r* = / e^ 2 ^, t > o, 

J 

and remark that T satisfies ([8]). Indeed, by Remark l3.ll yo(M) -1 solves the second equation 
of (|13|) hence Condition C3 implies that £ has the same law asYo (Af) _1 under P x ,y The 
property (jHJ) therefore follows from C2' since J* Y^~^_i (is is the inverse of J Y^ds. 

Of course, we may deduce from (|8|) together with the fact that £ never vanishes, that 
r is a continuous and strictly increasing process. Thus, A = T~ l is also a continuous and 
strictly increasing process satisfying ©. As a consequence, the two technical Properties 
PI and P2 on page [5] must again be valid. 

As £ is Tt - adapted, we see that 

G t = x+ f a(G s )£ s dM s , t>0,a.s., (14) 
J o 

6 = y+ I v(Zs)dMl+ [ e(t s )dr s > 0, t>0,a.s., (15) 

Jo Jo 
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where (J8j) implies that the continuous local martingales M and given by the stochastical 
integrals 

M s = f iu l dW u and M| = ( tfcMfi 
Jo Jo 

exist for each s > 0. Now it immediately follows from (|14p .(|15 p that the T At - adapted 
processes X = G o A and Y = £ o A on (f2, T , P) constitute a non-exploding weak solution 
of the system ©,© with Y t E S, t > 0, since B = M o A and B Y = A are 
Brownian motions by the Dambis-Dubins-Schwarz Theorem [RY1999, V.1.6] and 

(B, B Y ) t = (M, M*) At = 5 ^ 2 du = 5T At = St, t> 0, a.s., 

Jo 

by Property PI. 

Remark 3.2 (i) Combining Remark l3.1l and Condition C3, it follows from the construc- 
tion above that (X,Y) must have the same distribution as (X, Y) under P x ,y 

(ii) The filtration T At i t > 0, might be bigger than the filtration generated by (X,Y). 
However, it is straightforward to show the strong Markov property of (X,Y) with 
respect to T At , t > 0, since (X,Y) was obtained by time-changing a unique strong 
solution of a system of stochastic differential equation driven by Brownian motions. 

This remark makes clear that the following proposition can be proved by applying the ideas 
used in the proof of Proposition 12.41 in Section [2] ( so we omit its proof). 

Proposition 3.3 Let G,X,Y be the processes on the filtered probability space (£l,J-,J-t, 
t > 0, P) introduced above and starting from Go = Xq = x E K and Yq = y £ S. Then, for 
any T £ [0, oo], it follows that 

v(x,y) = sup E [e~ qT g(X T )] = sup E [e~ qVp g(G p )] 
reTr p&Mt 

where 

T T = {t ET :0 <r <T} and M T = {p £ M : < p < A T }. 

Here, T and M. denote the family of finite stopping times with respect to the filtration 
{F At ) t >o and (F t )t>o, respectively. 

Remark 3.4 The above representation of the value function v{x, y), (x, y) £ R x S, could 
be extended to cases were S is bigger than (0, oo). However, in such cases, the 
equation for £ in (|13p must admit solutions starting from £q = which is an additional 
constraint, since £ is in the denominator on the right-hand side of this equation. 
Furthermore, in addition to the assumptions that 

Px, y ( / Y^ds < oo, Vt > 0) = 1 and P x y ( lim f Y^ds = oo) = 1, 
Jo ' *t°° Jo 

one would need to assume that J Y s ds is strictly increasing P^^-a.s. as, in principle, 
the process Y could now spend time at zero. 
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Recall that, in contrast to the case of regime-switching, the process Y above was con- 
structed by time-change from a solution of a stochastic differential equation and this results 
in some small variations from the proof of Theorem 12.51 Note that the conclusion of Propo- 
sition [3?3] remains valid for v(x,y'), X', 7J, M' T , A' and T' if these objects are constructed 
using a different starting point y' G S. 

Theorem 3.5 Let (X, Y) be a strong Markov process given on a family of probability spaces 
{Vt,J-,P X) y,{x,y) £ I x S) and let g : M — > K. be a measurable gain function such that 
{g > 0} 7^ 0. Assume <[3j), that (X, Y) satisfies Conditions CI' and C2' on page 1101 and 
that Condition C3 on paae\ll\ holds true for the system i!3\). Define JCj^ to be the collection 
of all finite stopping times r < T with respect to the filtration generated by (X, Y) such that 
d(X T ) > 0. Fix (x,y) 6lx5 and assume that v(x,y) = sup T£lc g+ E x>y [e~ qT g(X T )]. Then: 

v(x,y) < v(x,y') for all y' G S such that y < y' , 
so that v(x, y) is a lower bound for v(x, •) on [y, oo) n S. 

Proof. Fix x G K and y, y' G S with y < y' and choose a complete probability 
space (QjFjP) large enough to carry a pair of Brownian motions (W, W^) with covari- 
ation (W,WZ) t = 5t,t > 0. Let (G,£) and (£,£') be the solutions of (pj) starting from 
(x, y) and from (x, y'), respectively, which are both given by (W,W*) on Remark 
that G is indeed the same for both pairs since (fT3l) is a system of decoupled equations. 

Define C = inf {t > > and set & = < C) + #/(t > C) so that & < # for 
all i > 0. Obviously, (G, £) solves the system ([TBI) starting from Go = x and £o = y hence 
£t = £t < £t, i > 0, a.s., by strong uniqueness. 

Construct X = G o A and X' = G o A' using the above (G,£) and (G, £') and observe 
that > follows immediately from < £t < £j for all £ > a.s. Thus, simply using 
Proposition 13.31 instead of Proposition 12.41 the rest of the proof can be copied from the 
corresponding part of the proof of Theorem 12.51 □ 

Remark 3.6 For a discussion of the condition v(x,y) = sup rg ^- s + E XjV [e~ qT g(X T )] we 
refer the reader to Remark 12.61 Corollary 12.71 remains true if it is reformulated in the 
terms of the theorem above instead of Theorem 12.51 

4 Continuity in the Diffusion-Case 

Let S be an open subset of (0, oo), fix x G R and suppose that all the assumptions of 
Theorem 13.51 are satisfied. Furthermore, suppose that 

v(x,y) = sup E XiV [e- qT g(X T )} for all y G S. (16) 

For a sequence (y n )££Li Q <S converging to yo £ <S as n — > oo, denote by (G, £ n ) the solution 
of (fTB"j) . starting from Gq = x and £q = Vni n = 0, 1, 2, ... , given by a pair (W, W^) of 
Brownian motions with covariation (W,W^)t = St, t > 0, on a probability space (Q,J-,P). 
Using (G, £ n ) construct T n , n = 0, 1, 2, . . . , like T, A in Section [3 
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Lemma 4.1 Suppose that the ^-component corresponding to the unique strong solution to 
U3\) on paae\lCH is a Feller process with state space S. If the sequence (y n )^Li is monotone, 
that is either y n I yo or y n f yo when n — > oo, then 

T"-^r? and A? A% as n -)■ oo for all t > a.s. (17) 

Proof. Here, we will use without further comment the elementary fact that if U and V 
are two random variables with the same law and U > V a.s. then, in fact, U = V a.s. 

Suppose that y n ^ yo as n oo. By the coupling argument in the proof of Theorem 
13.51 without loss of generality one may chose £ n such that 

£>£*>■■■>£? >■■■>#> 0, t >0, n = 0,1,2,...; (18) 

hence the pathwise limit lim n £™, t > 0, exists. It follows from the Feller property that 
the two processes £° and (lim n (,™)t>o must have the same law by comparing their finite- 
dimensional distributions. As f) 181) also yields the inequalities lim n £™ > ^ > 0, i > 0, we 
see that ^ 

T° t > [ (KmCT 2 du = hmrr, t > 0, 
Jo n n 

by monotone convergence. But, if £° and (lim n Q)t>o have the same law then the same 
must hold true for T and f Q (lim n Q)~ 2 du, t > 0. Thus T° > J Q l (lim n Q)~ 2 du implies 
r t ° = f*(lim n Q)- 2 du a.s. for each t > 0. The desired result, r t ° = / *(lim n £™)~ 2 cb, t > 0, 
a.s, now follows since both processes have continuous paths. 

Thus r™ f F®, t > 0, a.s. Since A n , A are the right-inverses of the continuous increasing 
processes T n and T°, respectively, we have Af J, A®, t > 0, a.s., concluding the proof in the 
case where the (jjn 

) are decreasing. 
In the case where y n t yo as n ~ > °°; we see that 

< £<£<•••<£?<•••<# 

and ^ 

r° < / (limC)" 2 ^ = limr?, t>0, 
Jo n n 

by Lebesgue's dominated convergence theorem. This ensures that 17 1 r?, t > 0, a.s., and 
A% t A? , * > 0, a.s. □ 

In what follows, in addition to the assumptions of Theorem 13.51 we impose the assump- 
tion of Lemma 14.11 and the following condition C4 is used to summarise these conditions, 
that is, 

C4: — the gain function g satisfies {g > 0} 7^ 0; 

— the process (X,Y) satisfies Conditions ([3]), CI', C2' and the value function v 
satisfies (fTB]) for the chosen value of x; 

— Condition C3 holds true for the system (fl~3j) and the second equation in (fl~3j) has 
a Feller solution. 
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Note that, in many cases, the conditions one imposes on the coefficients r\ and 8 to ensure 
Condition C3 also imply that the whole solution of (|13p is a Feller process. 

We now discuss the continuity of the value function v(x, •) which we subdivide into 
left-continuity and right-continuity. 

Proposition 4.2 Assume Condition C4. Then, when T = oo, v(x, •) is left- continuous. 
Proof. First observe that Theorem 13.51 implies that 

limsupz;(3;,y n ) < v(x,y ), 

n—^oo 

whenever y n f vq in 5, so it remains to show that 

v(x,y ) < liminf v(x,y n ). 

n— >oo 

Recall the definition of M from Proposition 13.31 and choose p £ M. Then 

e- qr pg(G p ) > - e -<\g{G p )\ = -e-<\g(X® )\ (19) 

for all n = 1, 2, ... , since > r°. But the right-hand side of (fl"9|) is integrable by (|3|), thus 
the inequality 

Ee- qT °pg(G p ) < liminf Ee- qT pg(G p ) (20) 

n— >oo 

follows from Fatou's lemma and Lemma 14.11 

Now E e~ qF p g{G p ) < sup p / g;V i ^ e 9 p ' 9(Gp') an d so Proposition 13.31 gives 

Ee- qV ° P g{G p ) < lim inf v(x, y n ) (21) 

n— >oo 

since Mt can be replaced by Ai in the case where T = oo. So, taking the supremum over 
p £ in the left-hand side of (|2ip completes the proof. □ 

Remark 4.3 (i) The fact that v(x,yo) < limmf n ^ QO v(x,y n ) when y n \. yo in 5 is an 
immediate consequence of Theorem 13.51 As v(x,yo) < liminf n _ i , 00 v(x, y n ), y n t yo, 
was shown in the proof above, v(x, •) is, under Condition C4, lower semicontinuous 
on S when T = oo without any continuity-assumption on the gain function g. 

(ii) From (i) above it follows that, to establish right-continuity in the case where T = oo, 
it remains to show that limsup n _ s . 00 v(x, y n ) < v(x,yo) when y n \. yo in S. We are 
only able to prove this using the extra integrability condition of Proposition !4.4l below. 
Note that the combination of Proposition 14.21 and Proposition 14.41 gives continuity of 
v(x, ■) for fixed x in the case where T = oo without the requirement that the gain 
function g is continuous. 

(iii) If T < oo then the proof of Proposition 14.21 fails. Indeed, in this case, p cannot be 
chosen from M as it belongs to a different class A41^ for each n = 0, 1, 2, . . . We are 
able to show left- and right-continuity in the case where T < oo under the additional 
assumption that the gain function g is continuous — see Proposition 14.51 
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Proposition 4.4 Assume, in addition to Condition C4, that for each y € S there exists 
y > y such that (y, y) C S and 



sup E x>y i 
y<y'<y 



t>N 



as N t oo. 



Then, when T = oo, v(x, •) is right- continuous. 



Proof. Choose y £ S and y' £ (y, y)- Applying Proposition 13.31 with respect to x and 
y' yields v(x, y') = suppg^ E [e~ qV p g{G p )} since T = oo. Fix an arbitrary e > and choose 
an e- optimal stopping time p' e G M for v(x,y') so that 



< v(x,y')-v(x,y) <e + E[e ^^g(G p , ) - e'^g^ )]. 
Because Py > T', , the right-hand side of (1221) can be dominated by 

e + £ (l - e^ -1 ^) e - qT k \g{G p ,)\I{p'e < A' N ) + E e~ qV k \g{G p ,)\I{f 
< e + E(l- e^"^) e - qV k \g{G p ,)\I{p[ < A' N ) + E [sup e~%(Xi)\ ] 

where 



(22) 



t>7V 



and both 



^[sup e -9*|5(X t ') 



g(G p ,)\ < sup e-^| 5 (G 



£ x y [ S upe- qt \g(X t )\] 



t<A' 



t>N 



< sup e-^\g(G t ) 



sup e-« r *b(l^)l < BO.pe-*\g(X*)\ (23) 



i<7V 



and 



(C 2 " (Q- 2 )du < / (C 2 " {0~ 2 )du 
o jo 



rv 



iV 



(24) 



on {p' e < A' N }. Hence choosing N large enough that 

sup E XtV > [sup e~ qt \g(X t )\ ] < e 
y<y'<y t>N 



we obtain from (1221): 



K^yO-^y)! < 2e + £(l-e JV) 



supe-^| 5 (Xf) 

i<7V 



(25) 



for some N depending on y but NOT on y' . 

Now, in inequality (|25|) . replace y and y' by yo and y n , respectively, with the (y n ) 
bounded above by y~o and decreasing to yo- Since sup t<Ar e _9 *|<7p4°)| is integrable, it 
follows by dominated convergence that 



. -g(lim„ r»„ -TV) 

hm m(x,y n j — v(x,yo) < 2e + E 1 — e ' n sup e 



■«\g(X?] 



16 



and so 

lim \v(x,y n ) - v(x,y )\ < 2e 

n— voo 

by Lemma l4.1i Since e is arbitrary we conclude with the desired result. □ 

Proposition 4.5 Assume, in addition to Condition C4, that the gain function g is con- 
tinuous. Then, when T < oo, v{x, •) is continuous. 

Proof. Following the proof of the previous proposition choose y,y' £ S with y < y', fix 
an arbitrary e > and choose an e - optimal stopping time p' e £ Ai' T so that 

< v(x,y')-v(x,y) < e + E [e~ 9 %(G p , ) - e" 9 ^^ ^ aAt )]. (26) 

Note that p' e < A' T and that p' € A At is used since one cannot conclude that v(x,y) > 
Ee~ qVp g{G p ) for stopping times p which may exceed At with positive probability. Therefore, 
in contrast to the case where T = oo, dominating the right-hand side of (|26p leads to an 
upper bound of 

e + E (l - e-^^'^) e" 9 ^ \g(G p ,)\ (27) 

+ S (l - e - 9(T -^ } ) e-'^I^JI I(A T < P ' e < A' T ) (28) 
+ ^e- 9T |<7(G p , ) - g(G AT )\ I(A T < p' t < A' T ) (29) 

by adding —e~ qT g(G p 'J + e~ qT g(G p >J in the case where At < p' e < ^4y. 

Now replace y and y' by y n and j/o> respectively, with y n f ?/o i n <5. Suppose for now 
that Lebesgue's dominated convergence theorem can be applied to interchange limit and 
expectation in (|27p .(|28 p , (|29p . Then it can be shown that 

lim \v(x,y n ) - v(x,y )\ < e 

n— too 

proving left-continuity since e was arbitrary. To see this first dominate 

r;o-r° by r^-r 

performing a calculation similar to (|24|) but using T instead of N. Then (|27|) tends to e as 
n -»• oo by Lemma O Secondly, since {A T < p° e < A T } = {T° An < T° p0 < T}, both (ggj 
and (|29p converge to zero as n — > oo by Lemma l4.1l and the continuity of g. 

Finally it remains to justify the application of the dominated convergence theorem. 
Observe that 

e- qT \g(G p o)\ < e- q %g{G p »)\ = e~<?b(X° )| < sup e~*\g{X*)\ 

pg 0<t<T 

since p° e < A T and 

e- qT \g{G Arh )\ = e- qr2 T\g(G A n)\ < sup e~ qr °\g(G t )\ < sup e~%{X°)\ 

t<A%, 0<t<T 
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since A% < A° T for all n > 1 which, by ©, gives an integrable bound with respect to all 
three terms (f27|) . ([28]) . (1291). 

For the right-continuity, replace y and y' by yo and y n , respectively, assuming y n I yo 
in S. Note that 

e- qT \g(G p n)\ < e- gr %\g(G p n)\ < supe"^^ 1 )! 

t<T 

where the second inequality is obtained following the line of inequalities in (|23p but using T 
and y± instead of N and y, respectively. As e~ qT \g(G A o^)\ < sup 0<i<T e~ qt \g{X^)\ too, dom- 
inated convergence can be applied again by ([3]) with respect to all three terms (p7|) . ([281) . (|29|) , 
Then (|27|) tends to e as n — > oo by Lemma 14 . 1 1 since T can be estimated by r^ n — T. 

Furthermore, (|28p and (|29|) converge to zero as n — > oo by Lemma 14.11 and the continuity 
of g since T — T pn < T — r™ on {Aj, < < AVf\. So, making e arbitrarily small completes 

the proof. □ 



5 Application to Option Pricing 

Assume that the dynamics of X are given by 

dX = XYdB {!') 

which is the special case a{x) = x of equation (pQ). In mathematical finance (1') describes a 
simple model for the discounted price of an asset with stochastic volatility Y. 

If exercised at a stopping time r, the American options we have in mind would pay off 
g{e rT X T ) where r > stands for the instantaneous interest rate which is assumed to be 
constant. So, for notational convenience, the discount rate q is replaced by r throughout 
this section. 

In this setup, assuming the measure P XtV is used for pricing when Xq = x and Yq = y, 
the price of such an option with maturity T G [0, oo] is 

v(x,y)= sup E x , y [e- rT g{e rT X T )} (2') 

0<t<T 

where the supremum is taken over all finite stopping times with respect to the filtration 
generated by {X, Y). This value function differs from the value function given by (|2]) since 
g is not applied to X T but to e TT X T and, as a consequence, some of the conditions for our 
results have to be adjusted slightly. 
First, the condition 



E 

x ,y 



sup e- rt \g(e rt X t )\I(t < oo) 

0<t<T 



< oo for all (x,y)€RxS (3') 



is now assumed throughout. Then 



v(x,y)= sup E [e~ VT g(e VT X T )] = sup E [e~ rTp g(e rVp G p )] 
reTr peMr 

is the analogue to what was obtained in Propositions 12.41 and 13.31 for the value function 
given by (J2|). However, in order to conclude the results of Theorems 12.51 and 13.51 for the new 
value function, a new condition has to be imposed on g. 
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Corollary 5.1 Let v be the value function given by (2'). In addition to the assump- 
tions made in either Theorem \2.5\ or \3.5\ assume that g is a decreasing function. De- 
fine K?^!~ to be the collection of all finite stopping times r < T with respect to the filtra- 
tion generated by (X, Y) such that g{e rT X T ) > 0. Fix (x,y) £ 1x5 and assume that 
v(x,y) = sup Tg/c a+ E X:V [e- rT g(e rT X T )}. Then: 

v(x, y) < v(x, y') for all y' G S such that y < y' , 
so that v(x, y) is a lower bound for v(x, •) on [y, oo) n S. 

Remark 5.2 (i) The proofs of this and the next corollary are contained in the Appendix. 

(ii) If g is a monotone function then it has a left and a right-continuous version. Note 
that the proof of Corollary 15.11 does not depend on choosing a specific version for g. 
But, when applying the corollary to show continuity properties of the value function, 
we will choose the right-continuous version in what follows. 

(hi) Of course, Corollary 15 . 1 1 does not depend on the specific choice of the diffusion coeffi- 
cient a in this section as long as (3') and all other assumptions of Theorem 12.51 or [3.51 
are satisfied. 

(iv) If a{x) = x then Condition C2 or C2' assumed in Corollary 15.11 ensures that the 
discounted price X is a positive exponential local martingale of the form 

X t = rrexp{ f Y s dB s -\ I Y s 2 ds}, t > 0, P XjV - a.s., 
Jo 1 Jo 

since the stochastic integrals $QY s dB s , t > 0, are all well-defined. Furthermore, 
because lim^oo f^Y^ds = oo P^-a.s., X t tends to zero for large t as in the Black- 
Scholes model. 

(v) From (iv) above it follows immediately that, in the case a(x) = x, all processes 
satisfying Conditions CI and C2 on page [3] have the same law. 

(vi) Note that, in this section, the equation for G in (|13p on page [101 coincides with the 
linear equation dG = GdW which has a unique non-exploding strong solution for all 
Go G M. Hence Condition C3 on page 1111 becomes a condition only on the coefficients 
77, 6 of the equation for £ in (|13l) . 

We now consider the diffusion case and discuss the results of Section U] for the value 
function given by (2'). So, let S be an open subset of (0, 00), fix x £ E and replace 
Condition C4 on page Q3] by 

C4': — the gain function g is decreasing and satisfies {g > 0} 7^ 0; 

— the process (X,Y) satisfies Conditions ((3j), CI', C2' and the value function v 
satisfies 

v(x,y) = sup E Xyy [e~ rT g(e rT X T )] for all y G S JM) 

t£K 3 t + 

for the chosen x (using the definition of K,?^ given in Corollary I5.ip ; 
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— Condition C3 holds true for the system (fT3|) and the second equation in ([13]) has 
a Feller solution. 



Corollary 5.3 Let v be the value function given by (2'). Assume Condition C4'. 



(i) If g is bounded from below then, when T = oo, v(x, •) is left- continuous and lower 
semicontinuous. 

(ii) If g is continuous and if for each y € S there exists y > y such that (y,y) Q S and 



SUP E X> y< 

y<y'<y 



supe- rt \g(e rt X t ) 



t>N 



as N | oo, 



then, when T = oo, v(x,-) is right- continuous. 
(Hi) If g is bounded from below and continuous then, when T < oo, v(x,-) is continuous. 



6 Examples 

Pricing of American Puts via Jobert and Rogers |JR20 06] using the Markov mod- 
ulated model 

dX = XYdB, Y finite state Markov chain. 

Notice that the value function in [JR2006] is more general than ours as the authors allow 
for an interest rate which depends on Y. So in what follows we always mean a constant 
interest rate when applying our results to the value functiorj! in |JR2006| . 

Obviously, the gain function g{x) = max{0, K — x} where K is the strike price is 
decreasing and satisfies both Condition (3') and 

v(x,y) = sup E x>y [e~ rT g(e rT X T )}, (x,y)eRxS. 

The Condition C2 on page [3] is trivially satisfied since the Markov chain Y has finitely 
many positive states, only. So, recalling Remark I5.2f iv)+(v). Corollary 15.11 implies that, for 
fixed the value function v(x,y) in [JR2006) is monotonously increasing in y £ S = 

{y±, . . . , yd} provided Y is skip-free. 

Knowing this monotonicity property of the value function massively reduces the com- 
putational complexity of PROBLEM 1 on page 2066 in jJR2006j. The authors verified that 
the value function is uniquely attained at a stopping time of the formEl 

r* = inf{i > : X t < b[Y t }} 

where the vector b[yi], i = l,...,d, is indexed by the states of the Markov chain Y and 
their PROBLEM 1 consists in finding the so-called thresholds b[yi\ which are assumed to 
be in the order b[y\] > ■■■ > b[yd\- It is then stated in a footnote on the same page 

2 Remark that the notation of the value function in [JR2006) is different because our Markov chain Y is, 
in their terms, a function a applied to the Markov chain playing the role of their volatility process. 
3 We again adapted the author's notation to ours in the definition of r*. 



20 



2066 that 'When it comes in practice to identifying the thresholds, no assumption is made 
on the ordering, and all possible orderings are considered.' Of course, this approach has 
exponential complexity. Our result on the monotonicity of the value function would reduce 
this complexity to choosing one ordering b[yi] > ■ ■ ■ > b[y<i\ if y± < ■ ■ ■ < y^ and Y is 
skip-free. Indeed, since r* is the unique optimal stopping time for this problem, by general 
theory, it must coincide with the first time the process (X, Y) enters the stopping region 
{(x,y) : v(x,y) = g(x)}. Thus, as it is not optimal to stop when g is zero in this example: 

v(x,yi) = g{x) for x < b[yi] while v(x,yi) > g{x) for x > b[yi] 

for each i = l,...,d which gives the unique ordering of the thresholds since g is strictly 
decreasing on {g > 0}. 

The Hull & White model |HW1987| 

dX = xWdB and dV = 2rj VdB Y + nVdt 

where rj, k > and B, B Y are independent Brownian motions^. Setting Y = VV transforms 
the above system into 

dX = XYdB and dY = r]YdB Y + OYdt 

where 6 = (k — rf)/2. Assuming a positive initial condition, this equation has a pathwise 
unique positive solution for every 77, G R. Calculating the equation for £ in (fT3l) on page 
[10] gives a constant diffusion coefficient r/ and if Z denotes then 

dZ = dW^ + ^Z- X dt 

which formally is an equation for a Bessel process of dimension <ft = 1+2$ /rj 2 . This equation, 
and so the equation for £, only has a unique non-exploding strong solution if (j) > 2 and 
this solution stays positive when started from a positive initial condition. As made clear in 
Section O the fact that Y satisfies Condition C2' on page [10] can be derived from Condition 
(jHJ) with respect to 

/■* 1 2 r* 1 

r * = / ~C2 dU = T I / ~72 dU ' 1 - °- 
JO JO Z u 

Now, by applying Prop.A.l(ii)-(iii) in |H2010j ) with respect to the second time integral 
above, we see that T satisfies Condition (j5|) if (j) > 2. So, assuming <fi > 2, Remark 
I5.2( iv)+(vi) ensures that there is a unique strong Markov process (X, Y) which satisfies 
Conditions CI' and C2' on page [10] and that the system (|13p satisfies Condition C3 on 
page [UJ in this example. Since Bessel processes are Feller processes (see |BY1999( p446]), 
the second equation of (fT3j) has a Feller solution. 

Therefore if (j) > 2 (i.e. k > 2ry 2 ) then the conclusions of the Corollaries 15.11 and 15.31 apply 
to perpetual American options whenever the corresponding pay-off function g satisfies the 
conditions stated. 



4 Remark that (B, B Y ) 7^ is possible but we follow Hull & White's original setup. 
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The Heston model [H1993] 

dX = xVVdB and dV = 2r] WdB Y + k(A - V)dt 

where 77, k, X > are constants and B, B Y are Brownian motions, this time with covariation 
5 € [—1,1]. The equation for V describes the so-called Cox- Ingersoll- Ross process and it is 
well-known (see [CIR1985] p. 391]) that, with a positive initial condition, this equation has 
a pathwise unique positive solution if kX > 2r/ 2 . Setting Y = yV transforms the system 
into 

dX = XYdB and dY = r) dB Y + (y - 9 2 Y^j dt 

with 6\ = (k\ — r/ 2 )/2 and 62 = k/2. It is clear that the pathwise uniqueness of the 
equation for V ensures the pathwise uniqueness of positive solutions of the equation for Y. 
Calculating the equation for £ in (fT3l) on page [10] yields 

« = ^ + (p-j)* 

hence Z = £ 2 / (2?/) satisfies 

with <fi = Oi/rf + 3/2. By changing to an equivalent probability measure, this equation 
for Z is transformed into an equation for a Bessel process of dimension (j) which only has a 
unique non-exploding strong solution if <f> > 2 and this unique strong solution stays positive 
when started from a positive initial condition. All these properties and the Feller property 
of Bessel processes carry over to the solutions of the equation for £. Finally, the process 

/"* 1 1 f* 1 

satisfies (|8|) if (ft > 2 (apply Proposition A.l(ii)-(iii) in [H2010] to the second integral) which 
implies Condition C2' on page [10] following the arguments given in Section [3] So, as in 
the previous example, all conditions imposed on X, Y, £ in the Corollaries 15.11 and 15.31 are 
satisfied if <j> > 2 or equivalently kX > 2rf . 

Appendix 

Proof of Lemma 12.31 Fix p G M and r > and set 

0,q = {uj G 17 : s < r^(w) if and only if ^4 s (w) < t for all < s, t < 00}. 

Then 

{r p < r} n o n {A r < 00} = {p < ^l r } n fi n {A < 00} 

implies 
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since both P(fi H {A- < oo}) = 1 by Property P2,© and {p < G J^f' Z '- Note that 
S7o H {A r < 00} € J^' Z ' Z as J-q' Z,Z already contains all P-null sets. 

Similarly, if r G T then {A,- < r} G T G A Z,Z where Ar r = r a.s. by Property PI, thus 
the inclusion J^^' Z C T r ' Z ' z must be true. □ 

Lemma A.l Let W, Z, A, M 6e given on the filtered probability space (Cl, JF,JFt,t > 0, P) as 
introduced in Section® Then the time-changed processes B = M o A and Y = Z o A are 
independent. 

Proof. Let , £ > 0, denote the augmentation of the filtration generated by W and 
define the so-called big filtration by 

T Ug = jpW v a ^ Zs . s > q}^ t > Q 

Note that W is an J-"^ 9 Brownian motion since W and Z are independent hence the stochas- 
tic integral M is a continuous J-^ ig local martingale. Since A is a functional of Z it must 
be an J^ 19 - time - change by the definition of the big filtration. As A satisfies ([9]), it follows 
from the Dambis-Dubins-Schwarz Theorem |RY1999| V.1.6] that B = M o A is an J- h J^ 
Brownian motion. But Y = Z o A is a functional of Z thus it must be independent of B 
since a({Z s : s > 0}) C J 7 ^ 9 = T ^ and 5 is independent of F h ^ . □ 

Proof of Corollary 15.11 The only part of the proof where the additional condition on 
g is needed is the verification of (I12p . But, for (2'), the modification of f 1 1 2 [) reads 

E [e- rr "g(e rT " G p ) < E [e- rr 'pg(e rr 'pG p )} for every p £ 

and the above inequality is indeed true because T t > T' t , t > 0, a.s., and g is decreasing. 
Note that the above set of stopping times M.j~ now denotes the set {p G Mt '■ g{e rTp G p ) > 
a.s.}. □ 

Proof of Corollary 15.31 First observe that Lemma 14.11 follows by simply applying 
Corollary 15.11 instead of Theorem 13.51 and can therefore be used in the proof below. 

Now, as the left-hand side of the estimate (|19p is trivially bounded from below since g 
is bounded from below, we obtain 

Ee- rr °g(e rT °G p ) < liminf E e~ rT p g(e rT p G p ) 

using Fatou's lemma, Lemma 14.11 and Remark I5.2l fii). The remaining arguments below 
(|20p used to show Proposition 14.21 also apply in the case where (2') holds proving the left- 
continuity claimed in Part (i) . And finally, the lower semicontinuity follows by the argument 
for lower semicontinuity given in Remark 14. 3f i). 

The proof of Part (ii) is along the lines of the proof of Proposition 14.41 with some small 
changes emphasised below. 

First, using the value function defined in (2'), the right-hand side of (I22p is dominated 
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by 

e + E (l - e - r(r "i- I >.)) e - rr / e | 9 ( e rr > E G p , )|I(p' e < A' N ) 

+ Ee- rT ^\g(e T k Gp ,) -g{e r ^G p ,)We < A 'n) 
+ Elsupe- rt \g(Xl)\] + E [sup e~ rt \g(X t )\ ] 

t>N t>N 

where the middle term 

Ee- rr r't\g(e rr k Gp ,) - g(e rr ^G p ,)\I(p' e < A' N ) (30) 

is new. Note that the e- optimal stopping time p' e can be chosen from the set = {p G 

M : g{e rV 'rG p ) > 0} and so 

— rT' rV — rT' rV — tT s rT s 

e <%(e ^G p /)| = e p*g(e ^G p /) < e Ag(e "«Gpj) 

< supe- rr ?| 5 (e rr ?G t )| < snpe~ rt \g{e rt Xf )|. 

Using this in place of the upper bound on the right-hand side of (|23p . we obtain that 
|t;(x,i/)-«(s,i/)| < 3e + J E(l-e" r(rA W" Ar) ) S upe- rt | 5 (e rt X|)| 

+ Ee- rV *\g(e rr k Gp ,) - g(e rT * Gp ,)\I(p' e < A' N ). 
So, after y and y' were replaced by yo and y n respectively, it only remains to show that 

lim E e- rT ^ \g{e rT % G p n ) - g{e rT h G p? )\I(j>» < A n N ) = 0. d30j) 

n— >oo 

This limit refers to the new term in (|30p which was not considered in the proof of Proposition 
14.41 But, by dominated convergence, (|30l ) would follow if, for almost every uj G 0, the 
equality 

lim | 5 (e rr ;?(-) M G p?M (^)) - g{e rr hU^ G { ^))\I{p n M < A n N (u)) = (31) 

holds, and this is true. Indeed, choose u G £1 such that both T^„ (^(w) — ► -/V as n — >• oo 
and t t—t Gtioo) is continuous. Define 

ci = sup \G t (uj)\, c 2 = T° y r (w) 

and observe that 

o < p?(u>)ro%(u) < Aiiu)) < 4»M^( w )<i;(,)), n = i,2,..., 

since y n J. yo an d yi < y~o by assumption. The functions g and i \-t e rt are uniformly 
continuous on [— e rC2 c\, e rC2 c\] and [0, C2], respectively. Hence, for the chosen uj, the equality 
(|3ip follows from 

< (l^ (w) (w) - I^ (w) M) < A%(u>)) < (r^n (w) (o;) - N) -+ as 00, 
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and almost all uj are of this type since the map i i — is almost surely continuous and 
liniji^oo r9n is almost surely equal to N by Lemma 14.11 

Part (iii) can be shown by combining the ideas of the proof of Part (ii) and the proof 
of Proposition 14.51 In addition to (|27l28l29p there will be an extra term like (|30|) . We only 
need to justify why Lebesgue's dominated convergence theorem can be applied with respect 
to this extra term after substituting the sequence y n , n = 1, 2, . . . , and here, but only in 
the case of y n f yo, one needs g to be bounded from below. □ 
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